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Abstract. We give two new expressions of subresultants, nested sub- 
resultant and reduced nested subresultant, for the recursive polynomial 
remainder sequence (PRS) which has been introduced by the author. The 
reduced nested subresultant reduces the size of the subresultant matrix 
drastically compared with the recursive subresultant proposed by the 
authors before, hence it is much more useful for investigation of the 
recursive PRS. Finally, we discuss usage of the reduced nested subresul- 
tant in approximate algebraic computation, which motivates the present 
work. 



1 Introduction 

The polynomial remainder sequence (PRS) is one of fundamental tools in com- 
puter algebra. Although the Euclidean algorithm (see Knuth pQ for example) 
for calculating PRS is simple, coefficient growth in PRS makes the Euclidean 
algorithm often very inefficient. To overcome this problem, the mechanism of co- 
efficient growth has been extensively studied through the theory of subresultants; 
see Collins [2J, Brown and Traub [3], Loos [3], etc. By the theory of subresultant, 
we can remove extraneous factors of the elements of PRS systematically. 

In our earlier research [5] , we have introduced a variation of PRS called "re- 
cursive PRS," and its subresultant called "recursive subresultant." The recursive 
PRS is a result of repeated calculation of PRS for the GCD and its derivative 
of the original PRS, until the element becomes a constant. Then, the coeffi- 
cients of the elements in the recursive PRS depend on the coefficients of the 
initial polynomials. By the recursive subresultants, we have given an expression 
of the coefficients of the elements in the recursive PRS in certain determinants 
of coefficients of the initial polynomials. However, as the recursion depth of the 
recursive PRS has increased, the recursive subresultant matrices have become 
so large that use of them have often become impractical [BJ. 

In this paper, we give two other expressions of subresultants for the recur- 
sive PRS, called "nested subresultant" and "reduced nested subresultant." The 
nested subresultant is a subresultant with expression of "nested" determinants, 
used to show the relationship between the recursive and the reduced nested sub- 
resultants. The reduced nested subresultant has the same form as the result of 



Gaussian elimination with the Sylvester's identity on the nested subresultant, 
hence it reduces the size of the subresultant matrix drastically compared with 
the recursive subresultant. Therefore, it is much more useful than the recursive 
subresultant for investigation of the recursive PRS. 

This paper is organized as follows. In Sect. [2l we review the concept of the 
recursive PRS and the recursive subresultant. In Sect. [3J we define the nested 
subresultant and show its equivalence to the recursive subresultant. In Sect. 31 we 
define the reduced nested subresultant and show that it is a reduced expression 
of the nested subresultant. In Sect. we discuss briefly usage of the reduced 
nested subresultant in approximate algebraic computation. 



2 Recursive PRS and Recursive Subresultants 

Let R be an integral domain and K be its quotient field, and polynomials F 
and G be in R[x}. When we calculate PRS for F and G which have a nontrivial 
GCD, we usually stop the calculation with the GCD. However, it is sometimes 
useful to continue the calculation by calculating the PRS for the GCD and its 
derivative; this is used for square-free decompositions. We call such a PRS a 
"recursive PRS." 

To make this paper self-contained, we briefly review the definitions and the 
properties of the recursive PRS and the recursive subresultant, with necessary 
definitions of subresultants (for detailed discussions, see Terui [5]). In this paper, 
we follow definitions and notations by von zur Gathen and Lucking [7]. 



2.1 Recursive PRS 

Definition 1 (Polynomial Remainder Sequence (PRS)). Let F and G 

be polynomials in R[x] of degree m and n (m > n), respectively. A sequence 
(Pi, . . . , Pi) of nonzero polynomials is called a polynomial remainder sequence 
(PRS) for F and G, abbreviated to prs(P, G), if it satisfies Pi — F, P2 = G, 
aiPi-2 = q_i-\Pi-\ + fiiPi, for i = 3, . . . ,1, where a 3 ,...,ai, /3 3 , . . . , $ are ele- 
ments of R and deg(Pi-i) > deg(Pi). A sequence ((013, fy), . . . , (a;,/3;)) is called 
a division rule for prs(P, G). If Pi is a constant, then the PRS is called com- 
plete. □ 

Definition 2 (Recursive PRS). Let F and G be the same as in Definition^ 
Then, a sequence (p[ X) , . . . , P^ , P[ 2) , . . . , P^ ] , . . . , P[ t] P/* 5 ) of nonzero 
polynomials is called a recursive polynomial remainder sequence (recursive PRS) 
for F and G, abbreviated to rprs(J 7 ', G), if it satisfies 

= F, P 2 (1) = G, P[f = 71 • gcd(P 1 (1) , P 2 (1) ) with 71 S R, 
(P?\p?\... )P V) = P r S \pV,pV ) , 

pik) = Pj c*-i )) p w = d_ P ik-^ pw = lk . gcd(Pi « P (*)) mth lk e R) (1) 

(pf\pf\...,pW)=prs(P 1 W ,P 2 (fe) ), 
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for k = 2, . . . ,t. Ifaf \ (if e R satisfy af ] P^\ = q£\p£\ + /f° 'if } for 
k — l,...,t and i = 3,...,lk, then a sequence ((0:3 , (3^), ■ ■ ■ , ( Q! |*\ Pi^)) * s 
called a division rule for rprs(-F, G). Furthermore, if pj- is a constant, then the 
recursive PRS is called complete. □ 



In this paper, we use the following notations. Let c\ — lc(P^ ' ), n\ 

t and i = 1, . . . , If., and let 



deg(p/ fe ^), jo = m and jk — Jij for k = 1 



j(*0 O) 
a) —n)' 



M 



1 for k = 1, . . . ,t and i = 1, . . . ,lk — 1. 



2.2 Recursive Subresultants 

We construct "recursive subresultant matrix" whose determinants represent the 
elements of the recursive PRS by the coefficients of the initial polynomials. 
Let F and G be polynomials in R[x) such that 



F(x) = f rn x m + ■■■ + f x°, G(x) = g n x n + ■■■ + 



gox 



(2) 



with to > n > 0. For a square matrix M, we denote its determinant by \M\ 



Definition 3 (Sylvester Matrix and Subresultant Matrix). Let F and G 
be as in ((2|). The Sylvester matrix of F and G, denoted by N(F,G) in $3$), is 
an (m + n) x (m + n) matrix constructed from the coefficients of F and G. For 
j < n, the j-th subresultant matrix of F and G, denoted by (F, G) in (0), 
is an (to + n — j) x (to + n — 2j) sub-matrix of N(F, G) obtained by taking the 
left n — j columns of coefficients of F and the left to — j columns of coefficients 
ofG. 



N(F, G) = 




, N^{F,G) 




(3) 



n— 3 rn—3 



Definition 4 (Recursive Subresultant Matrix). Let F and G be defined as 

in and let (P x , ■ ■ ■ , P[ , ■ ■ ■ , P\ , ■ ■ ■ ) be complete recursive PRS for 
F and G as in Definition^ Then, for each tuple of numbers (k,j) with k — 
1, . . . , t and j = jk-i — 2, . . . , 0, define matrix N~( k ^ — A^J) (F, G) recursively 
as follows. 

1. For k = l, let N ( y\F, G) = N^(F, G). 

2. For k > 1, let N^\F,G) consist of the upper block and the lower block, 
defined as follows: 

(a) The upper block is partitioned into (jk-i — jk ~ 1) x (jfe-i — jk ~ 1) 
blocks with diagonal blocks filled with Njj , where Njj is a 

sub-matrix of N^ k ~ 1 ^ k - 1 \F, G) obtained by deleting the bottom jk-i + 1 
rows. 
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(b) Let ^ be a sub-matrix of N^ k obtained by taking the 

bottom jk-i + 1 rows, and let JV^* - 1 *- 7 '* - 1 ' be a sub-matrix o/7v| fc_ljfc_1 ^ 
by multiplying the (jk-i + 1 — r)-th rows by r for r = jk-li then 
by deleting the bottom row. Then, the lower block consists of jk—i — j ' — 1 
blocks of 1,J ' fc_1 ^ suc/i i/iai i/ie leftmost block is placed at the top row 
of the container block and the right-side block is placed down by 1 row 
from the left-side block, then followed by jk-i — j blocks of N^ k l '^ h ~ 1 ' 
placed by the same manner as 1 >3>>- 1 \ 

Readers can find the structures of N^ k '^ (F, G) in the figures in Terui JBjj. Then, 
7V( fc J')(F,G) is called the (fe,j)-th recursive subresultant matrix of F and G. □ 

Proposition 1. For k = 1, . . . ,t and j < jk-i — 1, the numbers of rows and 
columns of N^(F,G), the {k,j)-th recursive subresultant matrix of F and 

G are (m + n- 2ji) [U^Wl-i - 2j'i - 1)} (2jk-i - 2j - 1) + j, (m + n - 
2 ii ) {llf=2 (2j'j-i - 2j, - 1) } (2 j fe _ i - 2j - 1), respectively. □ 

Definition 5 (Recursive Subresultant). Let F and G be defined as in (J2J, 
and Ze£ (Pf , • ■ ■ , P/ 1 , • ■ ■ , Pj , • ■ ■ , P; ) &e complete recursive PRS for F and 
G as in Definition [H For j = jfc-i — 2, . . . , and r = j, . . . , 0, ie< = 
M^ k ' 3) {F,G) be a sub-matrix of the (k,j)-th recursive subresultant matrix 
N~( k 'f)(F, G) obtained by taking the top {m + n — 2j\) x {$\i=2 Qjl-i ~ - 
l)}(2j fc _i-2j-l)-l rows and the ((m + n-2j 1 ){l\ k - 1 (2j l - 1 -2 Jl -l)}(2 Jk _ 1 - 
2j — 1) + j — r)-th row (note that ]Vr fc is a square matrix). Then, the poly- 
nomial S k j(F,G) = \N^ k ' j) \x j + ■■■ + \N^ k ' j) \x° is called the (k,j)-th recursive 
subresultant of F andG. □ 



3 Nested Subresultants 

Although the recursive subresultant can represent the coefficients of the ele- 
ments in recursive PRS, the size of the recursive subresultant matrix becomes 
larger rapidly as the recursion depth of the recursive PRS becomes deeper, hence 
making use of the recursive subresultant matrix become more inefficient. 

To overcome this problem, we introduce other representations for the subre- 
sultant which is equivalent to the recursive subresultant up to a constant, and 
more efficient to calculate. The nested subresultant matrix is a subresultant ma- 
trix whose elements are again determinants of certain subresultant matrices (or 
even the nested subresultant matrices), and the nested subresultant is a subre- 
sultant whose coefficients are determinants of the nested subresultant matrices. 

In this paper, the nested subresultant is mainly used to show the relationship 
between the recursive subresultant and the reduced nested subresultant, which 
is defined in the next section. 
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Definition 6 (Nested Subresultant Matrix). Let F and G be defined as in 
EP, and let (P x (1) , . . . , . . . , p[ t] , . . . , P®) be complete recursive PRS for F 
and G as in Definition^ Then, for each tuple of numbers (k,j) with k = 1, . . . ,t 
and j = jk-i — 2, . . . , 0, define matrix N^'^ (F, G) recursively as follows. 

1. For k = l, let N (1 ^(F,G) = N^(F,G). 

2. For k > 1 and r = 0, . . .,j k -i, let jV^" 1 '^- 1 ) f, e a sub-matrix of N^A-i) 
by taking the top (n 1 ^ ^+712 1 ' —2jj~—i — l) rows and the (n^ ^ +TI2 — 
jk-i — r)-th row (note that 1 '-" s_1 ^ is a square matrix). Now, let 

N^(F,G) = (V^.^PG), ^-u^&G)) , (4) 

where Sk-ij k _ 1 (F, G) is defined by Definition^ Then, N^ k ^(F, G) is called 
the (k,j)-th nested subresultant matrix of F and G. □ 

Definition 7 (Nested Subresultant). Let F and G be defined as in and 
let (P^\ P^\..., P[ l \ P, (t) ) be complete recursive PRS for F and G as 

in Definition^ For j = j k -i~2, . . . , andr = j, . . . , 0, let k ' j) = N} k ' j) (F, G) 
be a sub-matrix of the (k,j)-th nested recursive subresultant matrix N( k 'j\F, G) 
obtained by taking the top + — 2j — 1 rows and the (fij + — j — t) - 
th row (note that N^'^ is a square matrix). Then, the polynomial Skj{F, G) = 

x° is called the (fc,j)-th nested subresultant of F and 
G. ' □ 

We show that the nested subresultant is equal to the recursive subresultant 
up to a sign. 

Theorem 1. Let F and G be defined as in ([2]), and let (Pi , ■ ■ ■ , Pj , ■ ■ . , p[ 1 \ 

. . . , Pj ) be complete recursive PRS for F and G as in Definition^ For k = 
2, . . . , t and j — jk-i — 2, . . . , 0, define Uk.j, bkj, rk.j and Rk as follows: let 

Uk,j = {m + n- 2ji) jnf^C 2 ^-! - 2 3i ~ !)} ( 2 Jfe-i - 2j - 1) with u k = u k j k 

and u± = m + n — 2j\, bkj = 2fk-\ — 2j — 1 with bk — bk.j k and b\ = 1. 
r fcJ = (_i)(«fc-i-i)(i+2+---+(b fc ,j-i)) w j£/j rfc = rk jk an( i ri j = i f or j < n> ana < 

Rk = (Rk-i) bk rk with Rq = R% = 1. Then, we have 

S kd (F, G) = (Rk-!)""- r kJ S ktj (F, G). (5) 
To prove Theorem [TJ we prove the following lemma. 

Lemma 1. For k = 1, . . . ,t, j = jk-i — 2, . . . , and r = j, . . . , 0, we have 

\N^(F,G)\ = (R k -i) bk - rfcj \N^(F,G)\. (6) 

Proof. By induction on k. For k — 1, it is obvious by the definitions of the recur- 
sive and the nested subresultants. Assume that the lemma is valid for 1, . . . , k— 1. 
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Then, for r = j k - 



, 0, we have \Ni- 



(k-i,j k -i). 



R k -i\N^ k 1 ' jk - l) \. For anele- 



ment in recursive PRS (x), expressed as P- (x) = a \ k ^x n * H \-cl\qX , 



denote the coefficient vector for P^ k ' (x) by p\ K> = t (a (K \ k} , . 
exist certain eliminations and exchanges on columns which transform N^^ 1 m-i) 



Then, there 



to M^-iA-O 



we have M {k ljfc - l) 



O 

O-i) 



W k -i 


o 


* 





such that, for r = j, . . . , 0, 



O 



o 



with im^- 1 ^- 1 ^ 



|Wjt_i|o^, where M?' 1 '^ 



is a sub-matrix of M^ k 1 <^ k - 1 > by taking the top 



(fc-i) . (fe-i) 

i v ' _1_ m y ' 



- 2jk-i — 1 rows and the (n-[ 



(fe-i) , (k-i) 



-jk-i —T)-th row (note 
-2j fc _i-l).By 



(fc-i) , (k-i) 



that the matrix W k -i is a square matrix of order n\ 
the definition of N^(F,G), we have N^ k ^(F,G) = Wk- i\N^ (P^ , P^ k) ) , 
hence we have 



\N^(F,G)\ = \W k ^\ n( " )+n ^-^\N^(P^,P^)\. 



(7) 



On the other hand, there exist similar transformation which transforms 



N(k-i,j k -i) and Jlu 



into M ( fc-1 ' 3 '*- 1 5 = 



Pi 



and M'^- 1 ' 3 '*- 1 ) = 



O 



P? 7 



respectively, with |Wfc_i| = |Wfc_i| by as- 



sumption. Therefore, by exchanges of columns after the above transformations 
on each column blocks (see Terui [5] for detail), we have 



(i4_i) b « r kij \N^(F,G)\ = |W*_ 1 |»i* ) +»»* 5 -«|W T W)(P 1 (fc \pW)| 

(*).„(*) 



|^ fe _ i - 2j]N U) (p W ; pW } i (8) 

|iV^)(F,G% 



which proves the lemma. 



□ 



4 Reduced Nested Subresultants 

The nested subresultant matrix has "nested" representation of subresultant ma- 
trices, which makes practical use difficult. However, in some cases, by Gaus- 
sian elimination of the matrix with the Sylvester's identity after some pre- 
computations, we can reduce the representation of the nested subresultant ma- 
trix to "flat" representation, or a representation without nested determinants; 
this is the reduced nested subresultant (matrix). As we will see, the size of the 
reduced nested subresultant matrix becomes much smaller than that of the re- 
cursive subresultant matrix. 

First, we show the Sylvester's identity (see also Bariess |Sj), then explain the 
idea of reduction of the nested subresultant matrix with the Sylvester's identity 
by an example. 
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Lemma 2 (The Sylvester's Identity). Let A = (ay) be nxn matrix, and, for 



. . , n — 1, i = fc + 1, . . . , n and j = + . . . , n, let a 



(fc) 



an 



ail 



aik aij 

akk akj 
aik aij 



Then, we have \A\ 



,(fc-i) 

l kk 



n—k—1 



,(fe) 

4 fc+l,fc+l 



(fe) 



Jfe) 
*fc+l,n 



Q n.n. 



□ 



Example 1. Let -F'(x) and G(x) be defined as 

F(x) = a 6 x 6 + a 5 x 5 -\ ho , G(x) — b 5 x 5 + b 4 x A H h&o, (9) 

with a 6 7^ and o 5 7^ 0. We assume that vectors of coefficients (06,05) and 



(65, 64) are linearly independent as vectors over K, and that prs(F, G) = {P{ 



(i) 



F, P« = G, P 3 (1) 



gcd(F,G)) with deg(F 3 (1) ) = 4. Consider the (2, 2)-th 



nested subresultant; its matrix is denned as 

\ 

A 3 3A 3 4A 



( A 4 4 A 4 
A 3 3A 3 AA 4 
A 2 2A 2 3A 3 
Ai Ai 2A 2 
\A A! ) 



a e b 5 
a 5 64 b 5 
1 bj 



aj bj 



(10) 



for j < 4 with 6j 
S^aCF.G) as 



for j < 0. Now, let us calculate the leading coefficient of 



\N. 



(2,2), 







ae b 5 




a 6 65 




ae fos 






a 5 64 b 5 




a 5 64 65 




a 5 &4 65 






a 4 63 &4 




4a 4 4& 3 46 4 




0a 4 O63 O64 


^4 4 4,4.4 






a6 65 




a 6 65 




ae 05 


^3 3^3 


4A 4 




a 5 64 65 




a 5 64 bs 




05 64 65 


A 2 2A 2 


3A 3 




03 62 &3 




3a3 3&2 363 




4a4 46 3 4& 4 






ae b 5 




ae 65 




ae 05 






a 5 64 &s 




a 5 64 &5 




a 5 fo 4 65 






02 61 62 




2a 2 2bi 2b 2 




3a3 362 3b 3 



(11) 



IHI 



(■Ho 



To apply the Sylvester's identity on H, we make the (3, 1) and the (3, 2) elements 
in -Hp, 2 and -Hp, 3 (p = 1,2,3) equal to those elements in H p i, respectively, by 
adding the first and the second rows, multiplied by certain numbers, to the third 
row. For example, in H12, calculate xn and 2/12 by solving a system of linear 
equations 

j o 6 iri2 + a 5 y 12 = -4o 4 + o 4 = -3a 4 

[ O5X12 + 6 4 ?/i2 = -4& 3 + 63 = -3&3 

(Note that (JX2J) has a solution in K by assumption), then add the first row 
multiplied by X12 and the second row multiplied by 2/12, respectively, to the 
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third row. Then, we have H % 2 — 



a 6 65 
a 5 b A 65 
04 &3 /112 



with /112 = 464 + J/12&5- Doing 



similar calculations for the other we calculate h p ^ q for -f/p, 9 similarly as in 

the above. Finally, by the Sylvester's identity, we have 



\N, 



(2,2) 



a 6 65 
0,5 64 



a 6 b 5 

a 5 64 65 b 5 65 
a 4 63 64 h 12 /ii3 
a 3 62 &3 ^22 /l23 
a 2 h 6 2 /132 ^33 



a 6 65 
a 5 64 



(2,2), 



(13) 



note that we have derived N, 



Cr(2,2) 



as a reduced form of N. 



(2,2) 



□ 



Definition 8 (Reduced Nested Subresultant Matrix). Let F and G be 

defined as in ©, and let (P^\ . . . , P, (1) P (t) P (t)s > ^ —-7-+- ™™,™„<> 



, ) fee complete recursive 
PRS for F and G as in Definition® Then, for each tuple of numbers (k,j) with 
k = 1, . . . , t and j = jk-i — 2, . . . , 0, define matrix N^'^ (F, G) recursively as 
follows. 

1. For k = 1, let N^'3)(F,G) = N^(F,G). 

2. For k > 1, let N^' 1 ' jk - l] (F, G) be a sub-matrix of N^ k ~ 1 ^ k - 1 \F, G) by 
deleting the bottom jk-i + 1 rows, and N { ^ 3h - l] {F,G) be a sub-matrix 
of N( k - l >^-i)(F,G) by taking the bottom j k _ 1 + 1 rows, respectively. For 
t = j fc _i,...,0 let N^ hjk - l} (F,G) be a sub-matrix of N&-ij h -i) (j? G ) 

r + l)-th row of 



by putting Ny ljfc (F,G) on the top and the (jk-i 



struct a matrix H as 



|^_(fe-ij fc -i)| and mn _ 



H = (H p . q ) = NV) (A^Hx), ±A^\ X )^ 



(14) 



where A^-^lx) = A {k l) x ik ^ + • • ■ + Ai k 1] 'x° . Since N { T k h3k - l} consists 
of iJfc-i) anc i a row vec i or j n iii e bottom, we express JSfjj 1 1 — 



(7j( fc )|t?( fc )), where is a square matrix and is a column vector, and 

the row vector by (b p k ,l gp k q^ 
number, respectively, such that 



where b p k } q is a row vector and g p k \ is a 





„(*) 


u p,q 





(15) 



with b 



(k) _ 



•_„.,, — and g p k ) q = for H p q = 0. Furthermore, 



we assume 



that t/W is 



not singular. Then, forp — 1, . . . , n\ + 



(*)_!_„(*) 



-j and q = 2, 



calculate a row vector x p k \ as a solution of the equation Xp^f/W = b 



(k) , (fc) 
(fe) 



-J, 
and 
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define h p 



(fc) 



■Jfc) _ 

lp,q — 



x p k) q v^. Finally, define (F, G) as 



N {k ^{F,G) 



Jk,j 



= nf» 



( 

b (k) 
1,1 

b {k) 

"2,1 



„<*) 
(fc) 

9 1.1 

(fc) 

92.1 



1 ( fc ) /;W . . . / 



„(*) 

''1,2 
"■2.2 



,(fe) 



j(fc) 

2, Jfe,j 



( fe) 



-j = (2j fc _i-2j-l)+j, 



,(*) 

'2 



2j = 2i fe _! - 2j - 1. 



(16) 



(17) 



Then, N^ k '^(F, G) is called the (fc, j)-th reduced nested subresultant matrix 
of F and G. □ 

Proposition 2. For fc = 1, . . . ,t and j < ju—i ~ 1; the numbers of rows and 
columns of the (k,j)-th reduced nested subresultant matrix N^'^'(F, G) are (m + 
n — 2(k — 1) — 2j) + j and (m + n — 2(fc — 1) — 2j), respectively. 

Proof. By induction on fc. It is obvious for fc = 1. Assume that the proposition 
is valid for 1, . . . , fc — 1. Then, the numbers of rows and columns of matrix 
in (fTB|) are equal to (m + n— 2{(fc — 1) — 1} — 2jk-i) — 1, respectively. Therefore, 
by P^|) and (fTT|) , we prove the proposition for fc. □ 

Note that, as Proposition [2] shows, the size of the reduced nested subresultant 
matrix, which is at most the sum of the degree of the initial polynomials, is much 
smaller than that of the recursive subresultant matrix (see Proposition [T). 

Definition 9 (Reduced Nested Subresultant). Let F and G be defined as 



(i) 



P 



(i) 



p 

: 1 1 



in ©, and let (P| 
F and G as in Definition fJl For j 



(*) 



. . , Pj ) be complete recursive PRS for 
jk-i — 2, . . . , and r = j, . . . , 0, Zet 
^fe,i) = ^ fc!i) (P,G) 6e a sub-matrix of the (k,j)-th reduced nested subresultant 
matrix N^ k '^(F, G) obtained by the top m + n — 2(fc — 1) — 2j — 1 rows and the 
(m + n — 2(fc — 1) — j — r)-th row (note that Nt°'^ (F, G) is a square matrix). 
Then, the polynomial S kd (F,G) = |iVf J) (F,G)\x j + ■■■ + \N^' j) (F, G)\x° is 
called the (k,j)-th reduced nested subresultant of F and G. 



□ 



Now, we derive the relationship between the nested and the reduced nested 
subresultants. 



Theorem 2. Let F and G be defined as in @, and let (Pf 



(i) 



P (i) 
''Mi ' 



(0 



• r l 

. . . , P^') be complete recursive PRS for F and G as in Definition^ For k = 
2, . . . , t, j = jk-i — 2, . . . , with Jk.j as in H16\). define B>k.j and R k as D>k,j = 
|[7(fe)|A,,-i mth Bk = Bk jk and B 1 = B 2 = 1, and R k = (P fe _x • P fc _i) Jfc -^ 
with R\ — R2 — 1, respectively. Then, we have 



S ktj (F,G) = (P fe _! • Ih. ,i' B k;J ■ S kJ {F,G). 



(18) 
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To prove Theorem [5J we prove the following lemma. 

Lemma 3. For k = 1, . . . ,t, j = jk-i — 2, . . . , and t = j, . . . , 0, we have 

\N^(F,G)\ = (R k -x ■ B k -i) Jk -B kj \N^(F,G)\. (19) 



Proof. By induction on k. For k = 1, it is obvious from the definitions of the 
nested and the reduced nested subresultants. Assume that the lemma is valid 
for 1, . . . , k — 1. Then, for r = jk-i, ■ • ■ , 0, we have 



=(£*-i ■B k - 1 )\Ni k - 1 ^-^(F,G)\. 



(20) 



Let 4 fe " 1} 



and & k -* 



of the (fc, j)-th nested subresultant, we have 



Then, by the definition 



\Ni k ' j) \ = 



5 C=-i) 

Jft-1 



A 2j-j fc _ 1+ 3 

1^ 



if*:- 1 ) 

Jfc_i 



-i fc _i+ T +2 



Jfc-1 



- 3)A 



(j - Jfc_i + T + 2)A 



2j-jfc_i+3 



3-Jfc_l+ T +2 



Jfc-1 



3+2 



(21) 



(22) 



where A [k ~ 1] = for I < and iT = (f£ ff ) is defined as (EJJ) with i| fc 1} 



replaced by A| fc ^ (note that Nr K ' J> and iJ' are square matrices of order J k .j). 



Then, by Definition [51 we can express H' p q as H' p q — 



and g'p^ 
and g'p k q 





v {k) 




t{k) 

9p,q 



with b 



t{k) 







for H' v q 
■ gp)q for p = 1 



0. Note that, for q = 1, . . ., we have 6p,^ = 6p fc <] 



1, and 6' 



/(fc) 



where b p k \ and <7p^ are defined in (|15p . respectively. Furthermore, by 
the definition of h^l in Definition [5J we have 



9i, 



\H'\ 





v w 








b >(k) 

1,1 


(k) 
9i,i 




1,1 


"-1,2 





v w 






v w 


b >w 


(k) 




b '(k) 


h {k) 




v w 






„(*) 


b l(k) 


(fc) 




b ,(h) 


' k ,j - T < 2 





v w 


b '{k) 

1,1 


!, Jk,j 





v w 


b' [k) 


h (k) 


°J htj -l,l 


Jk,j — ll J k.j 




v w 


°I kij -T,l 


h {k> 

Ik, j ~ T 'Jk.j 



By Lemma [21 we have 

\ H '\ = p^l^-^N^i^G)] = B Kj \N^\F,G)\, 



(23) 



(24) 
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hence, by putting (|24[) into (|2"2")h we prove the lemma. 



□ 



Remark 1. We can estimate arithmetic computing time for the (k, j)-th reduced 
nested resultant matrix N^ k ^ in (fT!)]) . as follows. The computing time for the 
elements h p , q is dominated by the time for Gaussian elimination of U^ k \ Since 
the order of is equal to m + n ~ 2(k — 2) — 2jk~i (see Proposition [5]) , it 
is bounded by 0((m + n — 2(k - 2) - 2j fe _i) 3 ), or 0((m + n) 3 ) (see Golub and 
van Loan [9] for example). We can calculate N( k ^(F 7 G) for j < j fe _i - 2 by 
N^ k '°^(F,G), hence the total computing time for N^'^ for the entire recursive 
PRS (fc = 1, ...,£) is bounded by 0(t(m + n) 3 ) (see also for the conclusion). □ 

5 Conclusion and Motivation 

In this paper, we have given two new expressions of subresultants for the recur- 
sive PRS, the nested subresultant and the reduced nested subresultant. We have 
shown that the reduced nested subresultant matrix reduces the size of the matrix 
drastically to at most the sum of the degree of the initial polynomials compared 
with the recursive subresultant matrix. We have also shown that we can calcu- 
late the reduced nested subresultant matrix by solving certain systems of linear 
equations of order at most the sum of the degree of the initial polynomials. 

A main limitation of the reduced nested subresultant in this paper is that we 
cannot calculate its matrix in the case the matrix in ([15]) is singular. We 
need to develop a method to calculate the reduced nested subresultant matrix 
in the case such that is singular in general. 

From a point of view of computational complexity, the algorithm for the 
reduced nested subresultant matrix has a cubic complexity bound in terms of 
the degree of the input polynomials (see Remark [lj. However, subresultant al- 
gorithms which have a quadratic complexity bound in terms of the degree of 
the input polynomials have been proposed ([TO], HB); the algorithms exploit 
the structure of the Sylvester matrix to increase their efficiency with controlling 
the size of coefficients well. Although, in this paper, we have primarily focused 
our attention into reducing the structure of the nested subresultant matrix to 
"flat" representation, development of more efficient algorithm such as exploiting 
the structure of the Sylvester matrix would be the next problem. Furthermore, 
the reduced nested subresultant may involve fractions which may be unusual for 
subresultants, hence more detailed analysis of computational efficiency including 
comparison with (ordinary and recursive) subresultants would also be necessary. 

We expect that the reduced nested subresultants can be used for including ap- 
proximate algebraic computation, especially for the square-free decomposition 
of approximate univariate polynomials with approximate GCD computations 
based on Singular Value Decomposition (SVD) of subresultant matrices (fT2"1 
|13j). which motivates the present work. We can calculate approximate square- 
free decomposition of the given polynomial P(x) by several methods including 
calculation of the approximate GCDs of P(x), . . . , P™(i) (by pW(a;) we de- 
note the n-th derivative of P(x)) or those of the recursive PRS for P(x) and 
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P'(x); as for these methods, we have to find the representation of the subresul- 
tant matrices for P(x), . . . , P( n '(x), or that for the recursive PRS for P(x) and 
P'(x), respectively. While several algorithms based on different representation 
of subresultant matrices have been proposed ([13] [H]) for the former approach, 
we expect that our reduced nested subresultant matrix can be used for the latter 
approach. To make use of the reduced nested subresultant matrix, we need to 
reveal the relationship between the structure of the subresultant matrices and 
their singular values; this is the problem on which we are working now. 
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